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Abstract 

From a mathematical point of view self-organization can be described as patterns to which 
certain dynamical systems modeling social dynamics tend spontaneously to be attracted. In this 
paper we explore situations beyond self-organization, in particular how to externally control such 
dynamical systems in order to eventually enforce pattern formation also in those situations where 
this wished phenomenon does not result from spontaneous convergence. Our focus is on dynamical 
systems of Cucker-Smale type, modeling consensus emergence, and we question the existence of 
stabilization and optimal control strategies which require the minimal amount of external interven- 
tion for nevertheless inducing consensus in a group of interacting agents. First we follow a greedy 
approach, by designing instantaneous feedback controls with two different sparsity properties: com- 
ponentwise sparsity, meaning that the controls have at most one nonzero component at every instant 
of time and their implementation is based on a variational criterion involving ^i-norm penalization 
terms; time sparsity, meaning that the number of switchings is bounded on every compact interval 
of time, and such controls are realized by means of a sample-and-hold procedure. Controls sharing 
these two sparsity features are very realistic and convenient for practical issues. Moreover we show 
that among the controls built out of the mentioned variational principle, the maximally sparse ones 
are instantaneously optimal in terms of the decay rate of a suitably designed Lyapunov functional, 
measuring the distance from consensus. As a consequence we provide a mathematical justification 
to the general principle according to which "sparse is better" in the sense that a policy maker, who 
is not allowed to predict future developments, should always consider more favorable to intervene 
with stronger action on the fewest possible instantaneous optimal leaders rather than trying to 
control more agents with minor strength in order to achieve group consensus. We then establish 
local and global sparse controllability properties to consensus. Finally, we analyze the sparsity of 
solutions of the finite time optimal control problem where the minimization criterion is a combina- 
tion of the distance from consensus and of the ^i-norm of the control. Such an optimization models 
the situation where the policy maker is actually allowed to observe future developments. We show 
that the lacunarity of sparsity is related to the codimension of certain manifolds in the space of 
cotangent vectors. 
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sparse stabilization, sparse optimal control. 



MSC 2010: 34D45, 35B36, 49J15, 65K10, 93D15, 93B05 

* Conservatoire National des Arts et Metiers, Departement Ingenierie Mathematique (IMATH), Equipe M2N, 292 rue 
Saint-Martin, 75003, Paris, France, (marco.caponigro@cnam.fr) 

^Technische Universitat Miinchen, Facultat Mathematik, Boltzmannstrasse 3 D-85748, Garching bei Miinchen, Ger- 
many (massimo . f ornasier@ma. turn. de). 

* Rutgers University, Department of Mathematics, Business & Science Building Room 325 Camden, NJ 08102, USA 
(piccoli@camden.rutgers .edu). 

^Universite Pierre et Marie Curie (Univ. Paris 6) and Institut Universitaire de France, CNRS UMR 7598, Laboratoire 
Jacques-Louis Lions, F- 75005, Paris, France (emmanuel.trelat@upmc.fr). 



1 



Contents 



1 Introduction 2 

1.1 Self-organization Vs organization via intervention 2 

1.2 The general Cucker-Smale model and introduction to its control |4 

2 Sparse Feedback Control of the Cucker-Smale Model 9 

2.1 A first result of stabilization S 

2.2 Componentwise sparse feedback stabilization IS 

2.3 Time sparse feedback stabilization 13 

2.4 Componentwise sparse selections are absolutely continuous solutions [16 

3 Sparse is Better |^ 

3.1 Instantaneous optimality of componentwise sparse controls 17 

3.2 Complexity of consensus [21 

4 Sparse Controllability Near the Consensus Manifold [22] 

5 Sparse Optimal Control of the Cucker-Smale Model [24 

6 Appendix [27 

6.1 Proof of Lemma [T] 27 

6.2 Proof of Proposition Q] 27 

6.3 A technical Lemma 29 



1 Introduction 

1.1 Self-organization Vs organization via intervention 

In recent years there has been a very fast growing interest in defining and analyzing mathematical 
models of multiple interacting agents in social dynamics. Usually individual based models, described 
by suitable dynamical systems, constitute the basis for developing continuum descriptions of the agent 
distribution, governed by suitable partial differential equations. There are many inspiring applications, 
such as animal behavior, where the coordinated movement of groups, such as birds (starlings, geese, 
etc.), fishes (tuna, capelin, etc.), insects (locusts, ants, bees, termites, etc.) or certain mammals (wilde- 
beasts, sheep, etc.) is considered, see, e.g., [21 [181 UHl S3 SHI S3 E6j [63], [65] or the review chapter [8], 
and the numerous references therein. Models in microbiology, such as the Patlak-Keller-Segel model 
\39\ 150]. describing the chemotactical aggregation of cells and multicellular micro-organisms, inspired 
a very rich mathematical literature [35 1 136 ^ 152]. see also the very recent work [4] and references therein. 
Human motion, including pedestrian and crowd modeling |2H I22j. for instance in evacuation process 
simulations, has been a matter of intensive research, connecting also with new developments such as 
mean field games, see [30] and the overview in its Section 2. Certain aspects of human social behav- 
ior, as in language evolution [231 ESI [38] or even criminal activities [58], are also subject of intensive 
study by means of dynamical systems and kinetic models. Moreover, relevant results appeared in the 
economical realm with the theoretical derivation of wealth distributions [27] and, again in connection 
with game theory, the description of formation of volatility in financial markets [41] . Beside applica- 
tions where biological agents, animals and micro- (multi) cellular organisms, or humans are involved, 
also more abstract modeling of interacting automatic units, for instance simple robots, are of high 
practical interest pH E7J EH EH ED [57] . 
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One of the leading concepts behind the modeling of multiagent interaction in the past few years has 
been self- organization [6j 25j 2HJ [4_9j [63] , which, from a mathematical point of view, can be described 
as the formation of patterns, to which the systems tend naturally to be attracted. The fascinating 
mechanism to be revealed by such a modeling is how to connect the microscopical and usually binary 
rules or social forces of interaction between individuals with the eventual global behavior or group 
pattern, forming as a superposition in time of the different microscopical effects. Hence, one of the 
interesting issues of such socio-dynamical models is the global convergence to stable patterns or, as 
more often and more realistically the instabilities and local convergence |52j . 

While the description of pattern formation can explain some relevant real-life behaviors, it is also of 
paramount interest how one may enforce and stabilize pattern formation in those situations where 
global and stable convergence cannot be ensured, especially in presence of noise [68], or, vice versa, 
how one can avoid certain rare and dangerous patterns to form, despite that the system may suddenly 
tend stably to them. The latter situations may refer, for instance, to the so-called "black swans", 
usually referred to critical (financial or social) events (3J [62] . In all these situations where the inde- 
pendent behavior of the system, despite its natural tendencies, does not realize the desired result, the 
active intervention of an external policy maker is essential. This naturally raises the question of which 
optimal policy should be considered. 

In information theory the best possible way of representing data is usually the most economical for re- 
liably or robustly storing and communicating data. One of the modern ways of describing economical 
description of data is their sparse representation with respect to an adapted dictionary \A3\ Chapter 
1]. In this paper we shall translate these concepts to realize best policies in stabilization and control 
of dynamical systems modeling multiagent interactions. Beside stabilization strategies in collective 
behavior already considered in the recent literature, see e.g. [551 EZ], t ne conceptually closest work to 
our approach is perhaps the seminal paper [52], where externally driven "virtual leaders" are inserted 
in a collective motion dynamics in order to enforce a certain behavior. Nevertheless our modeling 
still differs significantly from this mentioned literature, because we allow us directly externally and 
instantaneously to control the individuals of the group, with no need of introducing predetermined 
virtual leaders, and we shall specifically seek for the most economical (sparsest) way of leading the 
group to a certain behavior. In particular, we will mathematically model sparse controls, designed 
to promote the minimal amount of intervention of an external policy maker, in order to enforce nev- 
ertheless the formation of certain interesting patterns. In other words we shall activate in time the 
minimal amount of parameters, potentially limited to certain admissible classes, which can provide a 
certain verifiable outcome of our system. The relationship between parameter choices and result will 
be usually highly nonlinear, especially for several known dynamical system, modeling social dynamics. 
Were this relationship linear instead, then a rather well-established theory predicts how many degrees 
of freedom are minimally necessary to achieve the expected outcome, and, depending on certain spec- 
tral properties of the linear model, allows also for efficient algorithms to compute them. This theory 
is known in mathematical signal processing under the name of compressed sensing, see the seminal 
work [7] and [26], see also the review chapter |30| . The major contribution of these papers was to re- 
alize that one can combine the power of convex optimization, in particular £i-norm minimization, and 
spectral properties of random linear models in order to show optimal results on the ability of ^i-norm 
minimization of recovering robustly sparsest solutions. Borrowing a leaf from compressed sensing, we 
will model sparse stabilization and control strategies by penalizing the class of vector valued controls 
u = (ui, . . . , ujv) G (K ) by means of a mixed £± — i^-norm, i.e., 

N 

i=i 
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where here || • || is the ^-Euclidean norm on R d . This mixed norm has been used for instance in 
|29j as a joint sparsity constraint and it has the effect of optimally sparsifying multivariate vectors 
in compressed sensing problems [28] , The use of (scalar) ^i-norms to penalize controls dates back to 
the 60's with the models of linear fuel consumption [20]. More recent work in dynamical systems [66] 
resumes again ^-minimization emphasizing its sparsifying power. Also in optimal control with partial 
differential equation constraints it became rather popular to use Li-minimization to enforce sparsity 
of controls Q31 QH [Ml E3 [60l EZ] . 

Differently from this previously mentioned work, we will investigate in this paper optimally sparse 
stabilization and control to enforce pattern formation or, more precisely, convergence to attractors 
in dynamical systems modeling multiagent interaction. A simple, but still rather interesting and 
prototypical situation is given by the individual based particle system we are considering here as a 
particular case 

Xi — Vi 

< . _ 1 y-v Vj-Vj (1) 

Vi ~ N 2—* (i -j- \\ X j — Xi\\ 2 )P 

for i = 1, . . . , N, where (3 > and Xj G M. d , Vi £ M. d are the state and consensus parameters respectively. 
Here one may want to imagine that the UjS actually represent abstract quantities such as words of 
a communication language, opinions, invested capitals, preferences, but also more classical physical 
quantities such as the velocities in a collective motion dynamics. This model describes the emerging 
of consensus in a group of N interacting agents described by 2d degrees of freedom each, trying to 
align (also in terms of abstract consensus) with their social neighbors. One of the motivations of 
this model proposed by Cucker and Smale was in fact to describe the formation and evolution of 
languages [23^ Section 6], although, due to its simplicity, it has been eventually related mainly to the 
description of the emergence of consensus in a group of moving agents, for instance flocking in a swarm 
of birds [24j . One of the interesting features of this simple system is its rather complete analytical 
description in terms of its ability of convergence to attractors according to the parameter j3 > which 
is ruling the communication rate between far distant agents. For j3 ^ ^, corresponding to a still rather 
strong long - social - distance interaction, for every initial condition the system will converge to a 
consensus pattern, characterized by the fact that all the parameters Vi(t)s will tend for t —> +oo to 
the mean v — X/i=i which is actually an invariant of the dynamics. For j3 > ^, the emergence 
of consensus happens only under certain concentration conditions in state and consensus parameters, 
i.e., when the group is sufficiently close to its state center of mass or when the consensus parameters 
are sufficiently close to their mean. Nothing instead can be said a priori when at the same time one 
has f3 > | and the mentioned concentration conditions are not provided. Actually one can easily 
construct counterexamples to formation of consensus, see our Example [1] below. In this situation, it 
is interesting to consider external control strategies which will facilitate the formation of consensus, 
which is precisely the scope of this work. 

1.2 The general Cucker-Smale model and introduction to its control 

Let us introduce the more general Cucker-Smale model under consideration in this article. 

The model. We consider a system of N interacting agents. The state of each agent is described by 
a pair (xi,Vi) of vectors of the Euclidean space M. d , where Xi represents the main state of an agent 
and the its consensus parameter. The main state of the group of N agents is given by the iV-uple 
x = (x±, . . . , xn)- Similarly for the consensus parameters v = (vi, . . . , v jv). The space of main states 
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and the space of consensus parameters is (M d ) N for both, the product iV-times of the Euclidean space 
M d endowed with the induced inner product structure. 

The time evolution of the state (xi,Vi) of the i th agent is governed by the equations 

' ±i(t) = Vi(t), 



1 N (2) 

for every i = 1, . . . , TV, where a € C^QO, +oo)) is a nonincreasing positive function. Here, || • || denotes 
again the -^-Euclidean norm in M d . The meaning of the second equation is that each agent adjusts its 
consensus parameter with those of other agents in relation with a weighted average of the differences. 
The influence of the j th agent on the dynamics of the i th is a function of the (social) distance of the two 
agents. Note that the mean consensus parameter v = Yl%=i v i(t) i s an invariant of the dynamics, 
hence it is constant in time. 

As mentioned previously, an example of a system of the form (|2|) is the influential model of Cucker 
and Smale |23] in which the function a is of the form 

a(ll ^-- Xj|l) = (^Tp^W (3) 

where K > 0, a > 0, and j3 ^ are constants accounting for the social properties of the group of 
agents. 

In matrix notation, System (|2|) can be written as 

{x = v 
■ T (4) 

v = -L x v, 

where L x is the Laplaciarfj] of the N x N matrix (a(||xj — Xi\\) /N)^. =l and depends on x. The 
Laplacian L x is an N x N matrix acting on (Mr) , and verifies L x (v, ... , v) = for every v G M d . 
Notice that the operator L x always is positive semidefinite. 

Consensus. For every v G (M. d ) N , we define the mean vector v = jt v i an< ^ the symmetric 
bilinear form B on (M d ) N x (M. d ) N by 

1 N 1 N 

B i U > V ) = 7^2 Yl (u i -U j ,V l -V j ) = JjJ2{Ui,Vi) - ( U ,V), 
i,j=l i=l 

where (•, •) denotes the scalar product in M. d . We set 

Vf = {(v 1 ,...,v N )e(M d ) N | Vl = --- = v N £R d }, (5) 

N 

V ± = {(v u ...,v N )e(M d ) N | 5> = 0}. (6) 

i=l 



These are two orthogonal subspaces of (M ) . Every v G (Mr) can be written as v = vt + v± with 
Vf = (v, . . . , v) G V/ and v± G Vj_. 



1 Given a real N x N matrix A = (ay)i,j and « £ (R d ) JV we denote by the action of A on (R 1 *)^ by mapping v 
to (anvi + ■ ■ ■ + a,]vDjv)i=i,...,jv- Given a nonnegative symmetric N x N matrix A = (aij)ij, the Laplacian L of A is 
denned by L = D — A, with D = diag(di, . . . , rfjv) and d k = =1 cifej- 
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Note that B restricted to V± x V± coincides, up to the factor 1/N, with the scalar product on 
(R^)^. Moreover B(u,v) = B(u±,v) = B(u,v±) = B(u±,v±). Indeed B(u,Vf) = = B(uj,v) for 
every u, v G (M. d ) N . 

Given a solution (x(t),v(t)) of ([2]) we define the quantities 

1 N 

X(t) := B(x(t),x(t)) = ^pJ2 H z i(*) ~ x i 
and 

JV JV 

V(t) := fl(„(t), »(t)) = ^ E »«*(*) " ^(Of = n E K*)^ I' 2 ' 

ij'=l i=l 

Consensus is a state in which all agents have the same consensus parameter. 

Definition 1 (Consensus point). A steady configuration of System ([2]) (x,v) E (R ) x Vf is called 
a consensus point in the sense that the dynamics originating from (x, v) is simply given by rigid 
translation x(t) = x + tv. We call (M. d ) N x V/ is the consensus manifold. 

Definition 2 (Consensus). We say that a solution (x(t),v(t)) of System ([2]) tends to consensus if 
the consensus parameter vectors tend to the mean v = jj^ZiVi, namely if lim^oo Vi(t) = v for every 
i = l,...,N. ' 

Remark 1. Because of uniqueness, a solution of (|2|) cannot reach consensus within finite time, unless 
the initial datum is already a consensus point. The consensus manifold is invariant for ([2]). 

Remark 2. The following definitions of consensus are equivalent: 

(i) lim^oo Vi(t) = v for every i = 1, . . . , N; 

(ii) lim^oo v± { (t) = for every i = 1, . . . , N; 

(Hi) limj^oo V(t) = 0. 

The following lemma, whose proof is given in the Appendix, shows that actually V(t) is a Lyapunov 
functional for the dynamics of (J2j) . 

Lemma 1. For every t ^ 



—V(t) ^ -2a ( yV / 2NX(t)j V(t). 

In particular ifsup t ^ X(t) X then lim^oo V(t) = 0. 

For multi-agent systems of the form ([2]) sufficient conditions for consensus emergence are a partic- 
ular case of the main result of [32] and are summarized in the following proposition, whose proof is 
recalled in the Appendix, for self-containedness and reader's convenience. 

Proposition 1. Let (xq,vo) 6 (R^)^ x (R^)^ be such that Xq = B(xq,Vq) and Vq = B(xq,Vq) satisfy 

a(V2Nr)dr ^ y/% . (7) 



Then the solution of ([2]) with initial data (xq,vq) tends to consensus. 
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In the following we call the subset of (R d ) N x (R d ) N satisfying (J7J) the consensus region, which 
represents the basin of attraction of the consensus manifold. Notice that the condition ([7]) is actually 
satisfied as soon as Vq and Xq are sufficiently small, i.e., the system has initially sufficient concentration 
in the consensus parameters and in the main states. 

Although consensus forms a rigidly translating stable pattern for the system and represents in 
some sense a "convenient" choice for the group, there are initial conditions for which the system does 
not tend to consensus, as the following example shows. 

Example 1 (Cucker-Smale system: two agents on the line). Consider the Cucker-Smale system ([2|)- 
([3]) in the case of two agents moving on M with position and velocity at time t, {xi{t),v\{t)) and 
(x2(t),V2(t)). Assume for simplicity that j3 = 1,K = 2, and a = 1. Let x(t) = xi(t) — X2(t) be the 
relative main state and v(t) = v\(t) — V2(t) be the relative consensus parameter. Equation ([2]), then 
reads 

x = v 



with initial conditions x(0) = xq and v(0) = v q > 0. The solution of this system can be found by direct 
integration, as from v = —x/(l + x 2 ) we have 

v(t) — vq = — arctanx(t) + arctancco- 

// the initial conditions satisfy arctanxo + vq < tt/2 then the relative main state x(t) is bounded 
uniformly by tan (arctanxo + vq), satisfying the sufficient boundedness condition on the space variables 
in LemmaUlfor consensus. 

On the other hand, whenever arctanxo + v q > vr/2, which implies arctanxo + vq ^ tt/2 + e for 
some e > 0, the consensus parameter v(t) remains bounded away from for every time, since 

v(t) = — arctanx(i) + arctanxo + vq ^ tt/2 — arctanx(t) + e ^ e > 0, 

for every t > 0. In other words, the system does not tend to consensus. 



Control of the Cucker-Smale model. When the consensus in a group of agents is not achieved by 
self-organization of the group, as in Example HJ it is natural to ask whether it is possible to induce the 
group to reach it by means of an external action. In this sense we introduce the notion of organization 
via intervention. We consider the system ([2]) of N interacting agents, in which the dynamics of 
every agent are moreover subject to the action of an external field. Admissible controls, accounting 
for the external field, are measurable functions u = (u\, . . . ,un) : [0, +oo) — > (R ) satisfying the 
— ^g-norm constraint 

N 

^|k(i)KM, (8) 
i=i 

for every t > 0, for a given positive constant M. The time evolution of the state is governed by 



(9) 

Xj(t) - Xi{t)\\){Vj{t) - Vi (t)) + Uiit), 

for i = 1, . . . , N, and X{ S M d , V{ G M d . In matrix notation, the above system can be written as 

x = v 




(10) 
v = —L x v + u, 



7 



where L x is the Laplacian defined in Section [1.21 

Our aim is then to find admissible controls steering the system to the consensus region in finite 
time. In particular, we shall address the question of quantifying the minimal amount of intervention 
one external policy maker should use on the system in order to lead it to consensus, and we formulate 
a practical strategy to approach optimal interventions. 

Our first approach will be a greedy one, in the sense that we will design a feedback control which 
will optimize instantaneously three fundamental quantities: 

(i) it has the minimal amount of components active at each time; 

(ii) it has the minimal amount of switchings equispaced in time within the finite time interval to 
reach the consensus region; 

(iii) it maximizes at each switching time the rate of decay of the Lyapunov functional measuring the 
distance to the consensus region. 

This approach models the situation where the external policy maker is actually not allowed to predict 
future developments and has to make optimal decisions based on instantaneous configurations. Note 
that a componentwise sparse feedback control as in (i) is more realistic and convenient in practice 
than a control simultaneously active on more or even all agents, because it requires acting only on at 
most one agent, at every instant of time. The adaptive and instantaneous rule of choice of the controls 
is based on a variational criterion involving — ^2- norm penalization terms. Since however such 
componentwise sparse controls are likely to be chattering, i.e., requiring an infinite number of changes 
of the active control component over a bounded interval of time, we will also have to pay attention in 
deriving control strategies with property (ii), which are as well sparse in time, and we therefore call 
them time sparse controls. 

Our second approach is based on a finite time optimal control problem where the minimization crite- 
rion is a combination of the distance from consensus and of the — l^-norm of the control. Such an 
optimization models the situation where the policy maker is actually allowed to make deterministic 
future predictions of the development. We show that componentwise sparse solutions are again likely 
to be the most favorable. 

The rest of the paper is organized as follows: Section [2] is devoted to establishing sparse feedback 
controls stabilizing System Q to consensus. We investigate the construction of componentwise and 
time sparse controls. In Section [3] we discuss in which sense the proposed sparse feedback controls have 
actually optimality properties and we address a general notion of complexity for consensus problems. 
In Section [4] we we combine the results of the previous sections with a local controllability result 
near the consensus manifold in order to prove global sparse controllability of Cucker-Smale consensus 
models. We study the sparsity features of solutions of a finite time optimal control of Cucker-Smale 
consensus models in Section [5] and we establish that the lacunarity of their sparsity is related to the 
codimension of certain manifolds. The paper is concluded by an Appendix which collects some of the 
merely technical results of the paper. 
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2 Sparse Feedback Control of the Cucker-Smale Model 



2.1 A first result of stabilization 

Note first that if the integral J °° a(r)dr diverges then every pair (X,V) > satisfies ©, in other 
words the interaction between the agents is so strong that the system will reach the consensus no 
matter what the initial conditions are. In this section we are interested in the case where consensus 
does not arise autonomously therefore throughout this section we will assume that 

a G L^Oj+oo). 

As already clarified in Lemma [1] the quantity V{t) is actually a Lyapunov functional for the uncon- 
trolled System (JSJ). For the controlled System ^ such quantity actually becomes dependent on the 
choice of the control, which can nevertheless be properly optimized. As a first relevant and instructive 
observation we prove that an appropriate choice of the control law can always stabilize the system to 
consensus. 

Proposition 2. For every M > and initial condition (xo,fo) £ (M. d ) N x (R^)-^, the feedback control 
defined pointwise in time by u(t) = —av±(t), with < a ^ n^/b( ) ' sa ^ s fi es ^ e constraint (jHJ) for 
every t ^ and stabilizes the system ([9]) to consensus in infinite time. 

Proof. Consider the solution of ([9]) with initial data (xq,Vq) associated with the feedback control 
u = —av±, with < a ^ — , M Then, by non-negativity of L x , 

Ny/B(v ,v ) 

±V{t) = jB(v(tlv(t)) 

= -2B(L x v(t),v(t)) + 2B(u(t),v(t)) 

< 2B(u(t),v(t)) 

= -2aB{v ± (t),v ± {t)) 

= -2aV(t). 

Therefore V(t) ^ e~ 2at V(0) and V(t) tends to exponentially fast as t — > oo. Moreover 



N 

IK(*)H 2 = aN^Vif) ^ aiVyV^O) = M, 

i=l 

and thus the control is admissible. □ 

In other words the system Q-Q is semi-globally feedback stabilizable. Nevertheless this result 
has a merely theoretical value: the feedback stabilizer u = — av± is not convenient for practical 
purposes since it requires to act at every instant of time on all the agents in order to steer the 
system to consensus, which may require a large amount of instantaneous communications. In what 
follows we address the design of more economical and practical feedback controls which can be both 
componentwise and time sparse. 

2.2 Componentwise sparse feedback stabilization 

We introduce here a variational principle leading to a componentwise sparse stabilizing feedback law. 



N 

E 



Uj 



N 



N 

8=1 



«i(t)|| ! 



aVN 



\ 
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Definition 3. For every M > and every (x,v) G (R d ) N x (R d ) N , let U(x,v) be defined as the set 
of solutions of the variational problem 



N \ N 



mm ^B(v,u) + j (B(x,x)) ^2 \\ui\\j subject to \\uj\\ ^ M , (11) 

where 



i=i / i=i 



7(X) = / a(V2Nr)dr. (12) 

The meaning of (jlip is the following. Minimizing the component B(v,u) = B(v±,u) means that, 
at every instant of time, the control u G U(x, v) is of the form u = —a ■ v±, for some a = (a±, . . . , ajv) 
sequence of nonnegative scalars. Hence it acts as an additional force which pulls the particles towards 
having the same mean consensus parameter. Imposing additional £^ — ^-norm constraints has the 
function of enforcing sparsity, i.e., most of the a[s will turn out to be zero, as we will in more detail 
clarify below. Eventually, the threshold j(X) is chosen in such a way that the control switches-off as 
soon as the criterion (|7|) gets fulfilled. 

The componentwise sparsity feature of feedback controls u(x, v) G U(x, v) is analyzed in the next 
remark, where we make explicit the set U(x,v) according to the value of (x,v) in a partition of the 
space (R d ) N x ^ d ^ N 



Remark 3. First of all, it is easy to see that, for every (x, v) G (R d )^ x (]R a! ) Ar and every element 
u(x,v) G U(x,v) there exist nonnegative real numbers a^s such that 

if v u = 0, 

Ui(x,v) = { f_u . t , n (13) 

- ati-r. — '-rr if v± t / 0, 

where ^ YliLi a i ^ ^ ■ 

The componentwise sparsity of u depends on the possible values that the c^'s may take in function of 
(x,v). Actually, the space (M. d ) N x (M. d ) N can be partitioned in the union of the four disjoint subsets 
Ci > C-2 , C3 , and C4 defined by 

d = {(x,v) G (R d ) N x (R d ) N I B(v,v) < -f(B(x,x)) 2 }, 
C 2 = {( x ,v) G (R d ) N x (R d ) N I B(v, v) = j(B(x, x)) 2 }, 

C 3 = {(x,v) G (R d ) N x (R d ) N I B(v,v) > -f(B(x,x)) 2 , and there exists a unique i G {1, . . . , N} such 
that \\v±.\\ > for every j 7^ i}, 

d = {(x, v) G (R d ) N x (R d ) N I B(v, v) > 7(B(x, x)) 2 and there exist k > 2 and h, . . . , i k G {1, . . . , N} 
such that Hwjl^ || = ••• = \\v± ik \\ and \\v ±n \\ > \\v ±j \\ for every j g {h, . . .,i k }}. 

The subsets C\ and C3 are open, and the complement {C\ UCs) c has Lebesgue measure zero. Moreover 
for every (x, v) G C1UC3, the set U (x, v) is single valued and its value is a sparse vector with at most one 
nonzero component. More precisely, one has U\d = {0} and U\c 3 = {(0, . . . , 0, —Mv± i /\\v± i ||, 0, . . . , 0)} 
for some unique i G {1, . . . , iV}. 

If (x,v) G C2 U C4 then a control in U(x,v) may not be sparse: indeed in these cases the set U(x,v) 
consists of all u = (u±, . . . ,un) G (R ) such that U{ = —onv± i /\\v± i \\ for every i = 1, . . . , N, where the 
aj's are nonnegative real numbers such that ^ Yli=i a i ^ M whenever (x, v) G C2, and Yli=i ®i = M 
whenever (x,v) G C4. 
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By showing that the choice of feedback controls as in Definition[3]optimizes the Lyapunov functional 
V(t), we can again prove convergence to consensus. 

Theorem 1. For every (x,v) G (R d ) N x (M. d ) N , and M > 0, set F(x,v) = {(v,-L x v + u) \ u G 
U(x,v)}, where U(x,v) is as in Definition^ Then for every initial datum (xo,vq) G (R")-^ x (R d ) N , 
the differential inclusion 



with initial condition (x(0), i>(0)) = (xq,vq) is well-posed and its solutions converge to consensus as t 
tends to +00. 

Remark 4. By definition of the feedback controls u(x,v) G U(x,v), and from Remark [31 it follows 
that, along a closed-loop trajectory, as soon as V(t) is small enough with respect to j(B(x,x)) the 
trajectory has entered the consensus region defined by (|7|). From this point in time no action is further 
needed to stabilize the system, since Proposition Q] ensures then that the system is naturally stable 
to consensus. In particular the control switches-off automatically by being set to forever. It follows 
from the proof of Theorem Q] below that the time T needed to steer the system to the consensus region 



is not larger than § ( y/V(0) - 7pQ ) , where 7 is defined by CE]), and X = 2X(0) + ^^(O) 2 . 



Proof of Theorem [0 First of all we prove that (j!4[) is well-posed, by using general existence results 
of the theory of differential inclusions (see e.g. [TJ Theorem 2.1.3]). For that we address the following 
steps: 

• being the set F(x, v) non-empty, closed, and convex for every (x, v) G (R^)^ x (R^)^ (see 
Remark [3l), we show that F(x,v) is upper semi-continuous; this will imply local existence of 
solutions of (I14|) ; 

• we will then argue the global extension of these solutions for every t ^ by the classical 
theory of ODE's, as it is sufficient to remark that there exist positive constants ci,C2 such that 
\\F(x, v)\\ ^ ci|H| + c 2 . 

Let us address the upper semi-continuity of F(x, v), that is for every (xq, vq) and for every e > there 
exists 5 > such that 



where Bs(y), B e (y) are the balls of (R d ) Ar x (R d ) N centered in y with radius 5 and e respectively. As the 
composition of upper semi-continuous functions is upper semi-continuous (see [U Proposition 1.1.1]), 
then it is sufficient to prove that U(x,v) is upper semi continuous. For every (x,v) £ C\ UC3, U(x,v) 
is single valued and continuous. If (x,v) G C2 then there exist such that \\v± i \\ = ■ ■ ■ = 



\\ v ±i k \\ and Ib-L^ II > ll w -Li II for ever y 1 i ••-,*&}• If < mm «£{ii,...,i & } (Ib-L^ II - ll u J-i II) tllen 

U(Bs(x,v)) = U(x,v) hence, in particular, it is upper semi continuous. With a similar argument it 
is possible to prove that U(x,v) is upper semi continuous for every (x,v) G C4. This establishes the 
well-posedness of (fT4l) . 

Now, let (x(-),v(-)) be a solution of (|14p . Let T the minimal time needed to reach the consensus, 
that is T is the smallest number such that V(T) = ^y(X(T)) 2 , with the convention that T = +00 if the 
system does not reach consensus. Lett G (0,T), theny(t) > -y(X(t)) 2 . Thus the trajectory (x(-),v(-)) 
is in C3 or C4 and there exist indices ii, . . . , ik in {1, . . . , N} such that \\v± ii (t)\\ = • • • = (t)\\ and 
Ib-L^ (*)ll > \\ v ±j f° r every j ^ {i\, . . . , i/J. Hence if u(t) G U(x(t),v(t)) then 



(x, v) G F(x, v) 



(14) 




F(B s (x ,v )) C B £ (F{x ,v )), 



Uj(t) = \ aj \\v ±j (t)\\ 



if j G {ii,..., ijfc} 







otherwise 



v 



11 



where Y^j=i a ij = M. Then, 



±V(t) = j t B(v(t),v(t)) 
< 2B(u(t),v(t)) 

2 " 

= TfZ)(«i(<).«±i(*)) 
i=X 

2 

= IK, 

3=1 

M, 
iV 



-2 ||f_L. 



M 



< -2^VVW. (15) 
For clarity, notice that in the last inequality we used the maximality of Hfj.^ (i)|| for which 



or 



N „ , m,2 1 V^„ 
3=1 



1 / 1 V^„ 



1/2 



and eventually 



3=1 



4ik (*)i<4^- 



JV" ,lW " iV 

Let Vo = V(0) and Xo = X(0). It follows from Lemma[5]in Appendix, or simply by direct integration, 
that 

M x 



v{t) < (yy - tj , (16) 

and 

TV 4 

X ( t )^ 2X o + ^V 2 = X. 
Note that the time T needed to steer the system in the consensus region is not larger than 

^4(v^-7W). (17) 
and in particular it is finite. Indeed, for every t > To we have 

and Proposition [H in particular ([7|), implies that the system is in the consensus region. 

Since we have V(t) = B(v(t),v(t)) < -y(X(t)) 2 for every t > T, it follows that (sc(i), v(t)) G Ci, 
which implies that U(x(t),v(t)) = {0}. Then by Lemma [T] we infer that V(t) tends to 0. □ 

Within the set U(x,v) as in Definition [31 which in general does not contain only sparse solutions, 
there are actually selections with maximal sparsity. 
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Definition 4. We select the componentwise sparse feedback control u° = u°(x, v ) E U (x, v) according 
to the following criterion: 

• if B(v,v) < 7(x) 2 , then u° = 0, 

• if B(v, v) j(B(x, x)) 2 , let i E {1, . . . , N} be the smallest index such that 

ll^-Lill ^ tC^C^^^)) and ||«±J > \\v±j\\ for every j = 1, ... ,N, 

then 

u° = —M- — and u° = for every j ^ i. 

We would like to prove that actually there exists a solution to (|14p which uses exclusively the 
componentwise sparse control u° as in Definition i.e., 

z(t) = z + I' (f(z(s))+u°(z(s)))ds, z = (x,v), f(z) = (v,-L x v), (18) 

J 

is an absolutely continuous solution of (fT4"|) in the sense of Clarke, Ledyaev, Sontag, and Subbotin 
[12j . To do that, we will first construct piecewise C 1 solutions by sampling in time the componentwise 
sparse feedback control u° , and then we will show, by a compactness argument, that such sampled 
solutions actually converge uniformly to the one in (JTHJ) . In particular we shall prove in Section 12.41 
the following formal statement. 

Theorem 2. For every M > there exists a solution of (I14p associated with the componentwise 
sparse control u° as defined in Definition^ 

Let us stress that, as a byproduct of our analysis, we shall eventually construct practical feedback 
controls which are both componentwise and time sparse. 

2.3 Time sparse feedback stabilization 

Theorem Q] gives the existence of a feedback control whose behavior may be, in principle, very compli- 
cated and that may be nonsparse. In this section we are going to exploit the variational principle (jlip 
to give an explicit construction of a piecewise constant and componentwise sparse control steering the 
system to consensus. The idea is to take a selection of a feedback in U(x, v) which has at most one 
nonzero component for every (x,v) G (M ) N x (R") , as in Definition HI and then sample it to avoid 
chattering phenomena (see, e.g., [69j). 

The following definition of solution for discontinuous feedback has been given in [12] ■ 

Definition 5 (Sampling solution). Let U C W 71 , f : 1R" x U \— > f(x,u) be continuous and locally 
Lipschitz in x uniformly on compact subset of W l x U . Given a feedback u : W 1 — > U , r > 0, and 
xq £ R n we define the sampling solution of the differential system 

x = f(x,u(x)), x(0)=x , 

as the continuous (actually piecewise C l ) function x : [0, T] — > W 1 solving recursively for k 

±(t) = f{x(t), u(x(kr))), t G [fcr, (k + 1)t] 

using as initial value x(kr), the endpoint of the solution on the preceding interval, and starting with 
x(0) = xq. We call t the sampling time. 
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Theorem 3. Fix M > and consider the control u° law given by Definition^ Then for every initial 
condition (xo,vq) G (M. d ) N x (M a! ) Ar there exists tq > small enough, such that for all r G (0, tq] the 
sampling solution of ([9]) associated with the control u° , the sampling time r, and initial datum (x ,vq) 
reaches the consensus region in finite time. 

Remark 5. The maximal sampling time To depends on the number of agents N, the £^ — i^-norm 
bound M on the control, the initial conditions (xq,vq), and the rate of communication function o(-). 
The precise bounding condition (|19|) is given in the proof below. Moreover, as in Remark [H the 
sampled control is switched-off as soon as the sampled trajectory enters the consensus region defined 
by 0. This occurs within time T < T = 2N(y/v(o) --y(X)), where X = 2B(x ,x ) + 2 ^-B(vo,vo) 2 . 

Proof of Theorem [3 Let 

2N 4 

X = 2B(x ,x ) + —B(v ,v ) 2 . 
and let r > satisfy the following condition 

r fo(0)(l + Vn)^B(v ,v ) + m) +r 2 2a(0)M < (19) 



Denote by the sampling solution of System (J9J) associated with the control u°, the sampling 

time r, and the initial datum (xq,Vq). Here [•] denotes the integer part of a real number. Let 
u(t) = u°(x(T[t/T]),v(T[t/T})) and denote for si mplicity u°(t) = u°(x(t),v(t)), then u(t) = u°(r[t/r]). 

Let T > be the smallest time such that y/V(T) = ^(X) with the convention that T = +00 if 
y/V(t) > j(X) for every t ^ 0. (If \/V(0) = j(X) ^ 7(X(0)) the system is in the consensus region 
and there is nothing to prove.) For almost every t G [0,T], and by denoting n = [t/r], we have 

< 2B(u(t),v(t)) 

= 2fl(u° (tit), «(*))• ( 20 ) 

Let i in {1, ... , iV} be the smallest index such that ||uj. i (nr)|| ^ 1 1 ^J_ fc C 7 ^ 7 ") 1 1 f° r every k / i, so that 
u°(nr) = —Mv±.(nT)/\\v± i (nT)\\ and Uk{nr) = for every k^i. Then (|20p reads 

ly(t) < -^£#t) , (21) 



where 



Note that 



Moreover, by observing ||u_L,(t)|| ^ N I X^=i ll u -Lj (*)ll ) > we have also the following estimates from 
above 

-0(t)<IK(t)||<vQv0^. (23) 
We combine ((23]) and d2TJ) to obtain 

2M 



m ~ IKM|| ■ 
(nr) = \\v± i (nT)\\ ^ s/V(nr). (22) 

2 / Ar / 1 Y-A' IL,. ( + \\\2 
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and, by integrating between s and t, we get 



Af 



VW)<VW) + (t-s)^=. (24) 



Now, we prove that V is decreasing in [0,T]. Notice that 

d 1 1 N 

-J t v u{t) = jjJ2a(\\x k - Xi\\)(v ±k (t) - v u (t)) + Ui -j^J2'Ue 

k^i 1=1 

= w E a (i^ - ^id(^) - ^ (*)) - m h^Lii - 

Moreover, observing that by Cauchy-Schwarz 

N / N \ 1 / 2 / N \ V 2 

k=l \k=l J V fc=l / 

we have the following sequence of estimates 
1 1 1 N 

X E h± h (t)-v ±i (t)\\ < ^ E IK(*)II + IK(*)II < ^ H^ fc WH + ^V V 7 ^) < (l+^v^t). 

k^i kj^i k=l 

Hence 

(ft |k ±l (nr)|| 

= N\\v (nr)\\ ^ a(l|Xfc " Xl|l) ^ (t)± * " "W^'^H) " 
II J-.V J\\ fe _^ 

^-^«(°)En^-^J- M 

k+i 

> -o(0)(l + VN)y/V^j- Af. 
By mean- value theorem there exists £ € [nr, t] such that 

4>{t) > <j}{nr) - (t - nr) (a(0)(l + \/JV)V^(0 + Af 



Af 



Then, using the growth estimate (|24p on Vv, and estimating \/V{£) from above by y^VXnr) + 
rM/y/N, we have 

> 0(nr) - r (a(0)(l + yfN)y/V{nr) + Af) - r 2 2a(0)M. 



Plugging this latter expression again in (|21f) and using (1220 . we have 

d„, , 2Af 



jV(t) ^ -— (yi 7 ^-r(a(0)(l + v^)yV 7 (^) + A/) -r 2 2a(0)Af) . (25) 
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We prove by induction on n that V(t) is decreasing on [0, T]. Let us start on [0, r] by assuming 



y/V(0) > j(X), otherwise we are already in the consensus region and there is nothing further to 
prove. By (|25p and using the condition (|19p on r, we infer 

jV(t) ^ -™ (v/VXO) - T (a(0)(l + y/N)y/V(fij + m) - r 2 2a(0)Af 



iV V 2 

-M 7 (X)<0. (26) 



Now assume that V is actually decreasing on [0, nr], m < T, and thus y/V(nr) > "/(X). Let us prove 
that V is decreasing also on [tit, min{T, (n + 1)t}]. For every t E (nr, min{T, (n + 1)t}), we can recall 
again equation ([25]) . and use the inductive hypothesis of monotonicity for which \/V(0) ^ y/V(nr), 
and the condition (1191) on r to show 



^y(t) < (v^M - r + \/iV)\/^(nr) + Af) -r 2 2a(0)M 

< -^r- (7(X)-r (a(0)(l + \/iV)^/y(0) + Af) - r 2 2a(0)M 

This proves that V is decreasing on [0, T\. 

Let us now use a bootstrap argument to derive an algebraic rate of convergence towards the con 
sensus region. For every t E (0, T) by using (|25p . the fact that V is decreasing, and the condition (fT9l 
on r we have 



d , N 2M f /— — - MX)\ 



Then 



for every t E [0, T]. Finally we get T < 2iV( v / y(0) - j(X))/M. □ 

2.4 Componentwise sparse selections are absolutely continuous solutions 

We are now ready to prove Theorem [21 which states, in particular, that there exists a componentwise 
sparse stabilizer for System ([9]) with at most one nonzero component. 

Proof of Theorem^ Denote z = (x,v) an element of (R d ) N x (R d ) N . Let u° be the sparse feedback 
of Definition H Fix z = (x ,v ) E (R d ) N x (R d ) N . Let r be an admissible sampling time arbitrarily 
small as in Proposition [3] which determines a sampling solutions which converges to consensus. For 
every n > 1/r consider the sampling solution z n of ([9|) associated with the feedback u, the sampling 
time 1/n, and the initial data Zq. Therefore if u n (t) = u°(z([nt]/n)) and f(z) = (v,—L x v) we have 
that ^ 

z n (t) = z + (f(z n (s)) + u n (s))ds. 
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For a suitable constant a > 0, the linear growth estimate ||/(z)|| ^ a(||z|| + 1) holds, so that, in 
particular we have 

e Qi (a||z || +a + M)-a- M 



a 

where the bound is uniform in n. Therefore the sequence of continuous functions (z n )neN is equi- 
bounded by the constant 

e aT °(a||z || + a + M)-a-M 

O — . 

a 

The sequence (z n )neN is also equicontinuous. Indeed 

\\z n (t) - z n (s)\\ < I (||/(^(0)|| + M)d^(t- s)(a(C + 1) + M) 

J s 

for every n. For every e > 0, if 6 = e/(a(C + 1) + M) > then for every n one has ||^n(t) — Zn(s)|| < e 
whenever \t — s\ < 5. By Ascoli-Arzela Theorem, up to subsequences, z n converges uniformly to 
an absolutely continuous function z. By continuity f(z n (t)) converges to f(z(t)) for almost every t. 
Moreover, by definition u n (t) tends to u°(z(t)) for almost every t. By the dominated convergence 
Theorem, the limit function z satisfies 

z(t) = z + ! (f(z(s))+u°(z(s)))ds, 
Jo 

and it is therefore a solution of the differential inclusion (|14p associated with the sparse selection 
u°. □ 

3 Sparse is Better 

3.1 Instantaneous optimality of componentwise sparse controls 

The componentwise sparse control u° of Definition H] corresponds to the strategy of acting, at each 
instant of time, on the agent whose consensus parameter is farthest from the mean and to steer it 
to consensus. Since this control strategy is designed to act on at most one agent at each time, we 
claim that in some sense it is instantaneously the "best one". To clarify this notion of instantaneous 
optimality which also implies its greedy nature, we shall compare this strategy with all other feedback 
strategies u(x, v) € U(x, v) and discuss their efficiency in terms of the instantaneous decay rate of the 
functional V. 

Proposition 3. The feedback control u°(t) = u°(x(t),v(t)) of Definition^ associated with the solution 
((x(t),v(t)) of Theorem® is a minimizer of 

dt 

over all possible feedbacks controls in U(x(t),v(t)). In other words, the feedback control u°(t) is the 
best choice in terms of the rate of convergence to consensus. 
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Proof. Consider 

d TT , , Id v^-v .. 



di iV di 

i=i 



2 N 



2 w » 2^1^ 

EE a di^ -^-idc^.^j) - ik ii 2 ) + jjHw -jjY^ u h v u 

1 = 1 j = l 2=1 j = l 



Now consider controls u\,..., un of the form (I13p . then 

E^-^E u ^> = - E «*ikj + t? E E 



i=l j=l {i | t>x^0} {< I u^O} {j I 11 ^ 



X a*iKji + T7 E ( E u J-*' a ' 



{i I ^±^0} {j | ux^O} \{z | v ± ^0} 11 ^' 



E a *n^ 



since, by definition, ^i^i v ±i = 0- Then maximizing the decay rate of V is equivalent to solve 

AT N 

max y~]aj || ||, subject to ctj ^ 0, ^Jay ^ M. (27) 
In fact, if the index i is such that \\v± i || \\ v ±j II f° r i 7^ * as i n the definition of u°, then 

AT N 

E a iii^n < iKiiiE"^ M iKJ- 

i=i i=i 



Hence the control u° is a maximizer of (|27p . This variational problem has a unique solution whenever 
there exists a unique i E {1, . . . , N} such that ||fj_J| > \\v± j || for every j ^ i. □ 

This result is somewhat surprising with respect to the perhaps more intuitive strategy of activating 
controls on more agents or even (although not realistic) all the agents at the same time as given in 
Proposition [2j This can be viewed as a mathematical description of the following general principle: 



A policy maker, who is not allowed to have prediction on future developments, should 
always consider more favorable to intervene with stronger actions on the fewest possible 
instantaneous optimal leaders than trying to control more agents with minor strength. 



Example 2. The limit case when the action of the sparse stabilizer and of a control acting on all 
agents are equivalent is represented by the symmetric case in which there exists a set of indices A = 
{ii, t2, ■ ■ ■ ,ik} such that \\v± i \\ = ||i>_i_ im || and \\v± i \\ > \\v±j\\ for every j ^ A and for all ig,i m G A. 
In this case, indeed, the equation (j27|) of the proof of Proposition has more solutions. Consider four 
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Figure 1: The time evolution of the modulus of the velocities in the fully symmetric case of Example (2) 
In red the free evolution of the system, in blue the evolution under the action of a sparse control, and 
in green the system under the action of a distributed control. 



agents on the plane R 2 with initial positions a?i(0) = (—1,0), £2(0) = (0,1), £3(0) = (1,0), £4(0) = 
(0,-1) and velocities v\(0) = (— 1,0), ^(0) = (0,1), ^3(0) = (1,0), ^4(0) = (0,-1). Let the interaction 
function be a(x) = 2/(1 + x 2 ) and the bound on the control be M = 1. In Figure^ we represent the 
time evolution of the velocities of this system. The free evolution of the system is represented in red. 
The evolution under the action of the sparse control u° is in blue while in green the system under the 
action of a "distributed" control acting on all the four agents simultaneously with ol\ = ■ ■ ■ = «4 = 1/4. 
The system reaches the consensus region within a time t = 3.076 under the action of both the distributed 
and the sparse control. 

Example 3. We consider a group of 20 agents starting with positions on the unit circle and with 
velocities pointing in various direction. Namely, 

Xi (Q) = (cos(» + v / (2)),cos(i + 2 1v /(2))) and Vi (0) = (2sm(iy/{3) - 1), 2 sin(i v / (3) - 2)). 

The initial configuration is represented in Figure [H We consider that the interaction potential, as in 
the Cucker-Smale system is of the form ([3]) with K = a = (3 = 1 , that is 

1 + x z 

The sufficient condition for consensus ([7]) then reads 

W ^ —== (-- arctan(V2iVX) 
V2N V2 

The system in free evolution does not tend to consensus, as showed in Figure After a time of 100 
the quantity ^(100) ~ 1.23 while j(X(100)) ~ 0.10. 

On the other hand the componentwise sparse control steers the system to consensus in time t = 22.3. 
Moreover the totally distributed control, acting on the whole group of 20 agents, steers the system in a 
larger time, t = 27.6. The time evolution of y/V and ofj(X) is represented in Figure^ In Figured 
the detail of the moment in which the two systems enter the consensus region. 
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Figure 2: The initial configuration of Example [3l 




Figure 4: Comparison between the actions of the componentwise sparse control and the totally dis- 
tributed control. The time evolution for t G [0, 30] of \/V{t) (solid line in the sparse case and dash-dot 
line in the distributed case) and of ^y(X(t)) (dashed line in the sparse case and dotted line in the dis- 
tributed case). 
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Figure 5: Detail of the time evolution of \/V(t) and of j(X(t)) under the action of the componentwise 
sparse control and the completely distributed control near the time in which the two systems enter the 
consensus region. The solid line represents the evolution of \/V(t) under the action of the componen- 
twise sparse control and the dash-dot line the evolution of \/V(t) under the action of the distributed 
control. The dashed line represents the evolution of 7(X(i)) under the action of the componentwise 
sparse control and the dotted line the evolution of 'y(X(t)) under the action of the distributed control. 



3.2 Complexity of consensus 

The problem of determining minimal data rates for performing control tasks has been considered for 
more than twenty years. Performing control with limited data rates incorporates ideas from both 
control and information theory and it is an emerging area, see the survey Nair, Fagnani, Zampieri 
and Evans [44], and the references within the recent paper [15]. Similarly, in Information Based 
Complexity [461 147j . which is a branch of theoretical numerical analysis, one investigates which are the 
minimal amount of algebraic operations required by any algorithm in order perform accurate numerical 
approximations of functions, integrals, solutions of differential equations etc., given that the problem 
applies on a class of functions or on a class of solutions. 

We would like to translate such concepts of universal complexity (universal because it refers to 
the best possible algorithm for the given problem over an entire class of functions) to our problem of 
optimizing the external intervention on the system in order to achieve consensus. 

For that, and for any vector w G M d , let us denote supp(w;) := {i € {1, . . . , d} : Ui 0} and 
# supp(u;) its cardinality. Hence, we define the minimal number of external interventions as the sum 
of the actually activated components of the control # supp(u(ti)) at each switching time t£, which a 
policy maker should provide by using any feedback control strategy u in order to steer the system to 
consensus at a given time T. Not being the switching times to, t\, . . . , t£, . . . specified a priori, such 
a sum simply represents the amount of communication requested to the policy maker to activate and 
deactivate individual controls by informing the corresponding agents of the current mean consensus 
parameter v of the group. (Notice that here, differently from, e.g., [44], we do not yet consider 
quantization of the information.) 

More formally, given a suitable compact set K, C (R d ) N x (M. d ) N of initial conditions, the £± — 
^2-norm control bound M > 0, the set of corresponding admissible feedback controls ^ (M) C 
B £ N_ e d(M), the number of agents N G N, and an arrival time T > 0, we define the consensus 
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number as 



n := n(N,fy{M),K,T) 

f P 1 

inf < sup < > # supp(u(i^)) : (x(T; u), v(T, u)) is in the consensus region 



=o 



Although it seems still quite difficult to give a general lower bound to the consensus numbers, Theorem 
[3] actually allows us to provide at least upper bounds: for To = Tq(M, N, Xq, Vq, a(-)) = ^j-(\/V"(0) ~~ 
7(X)), and To = tq(M, N, xo, vo, a(-)) as in Theorem [3] and Remark O we have the following upper 
estimate 

f oo, T < T 

n{N,^(M),K,T) < ^ Bu P(an ,„ n)eK r (M,JV,x ,m,a(-)) . (28) 

Depending on the particular choice of the rate of communication function a(-), such upper bounds can 
be actually computed, moreover, one can also quantify them over a class of communication functions 
a(-) in a bounded set srf C L 1 (M + ), simply by estimating the supremum. 

The result of instantaneous optimality achieved in Proposition [3] suggests that the sampling strategy 
of Theorem [3] is likely to be close to optimality in the sense that the upper bounds (|28p should be close 
to the actual consensus numbers. Clarifying this open issue will be the subject of further investigations 
which are beyond the scope of this paper. 



4 Sparse Controllability Near the Consensus Manifold 

In this section we address the problem of controllability near the consensus manifold. The stabilization 
results of Section [2] provide a constructive strategy to stabilize the multi-agent system ([9]) : the system 
is first steered to the region of consensus, and then in free evolution reaches consensus in infinite 
time. Here we study the local controllability near consensus, and infer a global controllability result 
to consensus. 

The following result states that, almost everywhere, local controllability near the consensus man- 
ifold is possible by acting on only one arbitrary component of a control, in other words whatever is 
the controlled agent it is possible to steer a group, sufficiently close to a consensus point, to any other 
desired close point. Recall that the consensus manifold is (M. d ) N x V/, where V/ is defined by ([5]). 

Proposition 4. For every M > 0, for almost every x E (M. d ) N and for every v 6 V/, for every time 
T > 0, there exists a neighborhood W of (x, v) in (R d ) N x {R d ) N such that, for all points (xq,vq) and 
(x\,Vi) of W , for every index i € {1, . . . , N} , there exists a componentwise and time sparse control 
u satisfying the constraint ([8]), every component of which is zero except the i th (that is, Uj(t) = for 
every j ^ i and every t E [0, T]), steering the control system Q from (xo,vq) to (x\,vi) in time T. 

Proof. Without loss of generality we assume i = 1, that is we consider the system ([9]) with a control 
acting only on the dynamics of v\. Given (x,v) € (M. d ) N x V/ we linearize the control system ([9]) at 
the consensus point (x,v), and get d decoupled systems on R N x 1^ 

r x k = v k 

\v h = -L s v k + Bu, 

for every k = 1 , . . . , d where 

n\ 



B = 
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To prove the local controllability result, we use the Kalman condition. It is sufficient to consider the 
decoupled control sub-systems corresponding to each value of k = 1, . . . , d. Moreover the equations 
for x k do not affect the Kalman condition, the x k plays only the role of an integrator. Therefore we 
reduce the investigation of the Kalman condition for a linear system on W N of the form v = Av + Bu 
where A = —L s . Since A is a Laplacian matrix then there exists an orthogonal matrix P such that 

/0 • • • \ 



D 



P- 1 AP 



A 2 



Moreover since (1, . . 
the first line of P^ 1 



\0 ••• \ N J 

, 1) G ker A, we can choose all the coordinates of the first column of P and thus 
= P T are equal to 1. We denote the first column of P 1 by 

/ 1 \ 

a-2 



Bi 



\a N J 



Notice that B\ = P 1 B. Denoting the Kalman matrix of the couple (A,B) by 

K(A, B) = (B, AB,..., A N ~ 1 B) 

one has 

K{P~ l AP, P^B) = P~ l K(A, B) 
and hence it suffices to investigate the Kalman condition on the couple of matrices (D,Bi). Now, 



there holds 



K(D,B 1 



( 1 

«2 A2«2 A|a2 



\ 

A 2 «2 



\o!n Aatoat A^ajv ••• A^ 1 atN/ 
This matrix is invertible if and only if all eigenvalues 0, X2, ■ ■ ■ , \n are pairwise distinct, and all 
coefficients ct2, ■ ■ ■ ,on are nonzero. It is clear that these conditions can be translated as algebraic 
conditions on the coefficients of the matrix A. 

Hence, for almost every x € (WL d ) N and for every v G Vj, the Kalman condition holds at (x,v). 
For such a point, this ensures that the linearized system at the equilibrium point (x, v) is controllable 
(in any time T). Now, using a classical implicit function argument applied to the end-point mapping 
(see e.g. [64]), we infer the desired local controllability property in a neighborhood of (x,v). By 
construction, the controls are componentwise and time sparse. To prove the more precise statement of 
Remark it suffices to invoke the chain of arguments developed in [591 Lemma 2.1] and [331 Section 
2.1.3], combining classical needle-like variations with a conic implicit function theorem, leading to the 
fact that the controls realizing local controllability can be chosen as a perturbation of the zero control 
with a finite number of needle-like variations. 

□ 

Remark 6. Actually the set of points x G (M. d ) N for which the condition is not satisfied can be 
expressed as an algebraic manifold in the variables a(\\xi — xA\). For example, if x is such that all 



mutual distances 



are equal, then it can be seen from the proof of this proposition that 



the Kalman condition does not hold, hence the linearized system around the corresponding consensus 
point is not controllable. 
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Remark 7. The controls realizing this local controllability can be even chosen to be piecewise con- 
stant, with a support union of a finite number of intervals. 

As a consequence of this local controllability result, we infer that we can steer the system from 
any consensus point to almost any other one by acting only on one agent. This is a partial but global 
controllability result, whose proof follows the strategy developed in [161 E] f° r controlling heat and 
wave equations on steady-states. 

Theorem 4. For every (xq, vq) £ (M. ) x Vf, for almost every (x\,vi) £ (R ) x Vf, for every 5 > 0, 
and for every i = 1, . . . , N there exist T > and a control u : [0, T] — > [0, 8] d steering the system from 
(x,v) to (x,v), with the property Uj(t) = for every j ^ i and every t £ [0, T\. 

Proof. Since the manifold of consensus points (R d )^ x Vf is connected, it follows that, for all consensus 
points (xq,vo) and (xi,ui), there exists a C 1 path of consensus points (x T ,v T ) joining (xq,vo) and 
(xi, v±), and parametrized by r £ [0, 1]. Then the we apply iteratively the local controllability result of 
Proposition [31 on a series of neighborhoods covering this path of consensus points (his can be achieved 
by compactness). At the end, to reach exactly the final consensus point (xi,vi), it is required that 
the linearized control system at (xi,v\) be controllable, whence the "almost every" statement. □ 

Note that on the one hand the control u can be of arbitrarily small amplitude, on the other hand 
the controllability time T can be large. 

Now, it follows from the results of the previous section that we can steer any initial condition 
{xq,vq) £ (R^)^ x (M. d ) N to the consensus region defined by (J7|), by means of a componentwise and 
time sparse control. Once the trajectory has entered this region, the system converges naturally (i.e., 
without any action: u = 0) to some point of the consensus manifold (Bk. d ) N x Vf, in infinite time. This 
means that, for some time large enough, the trajectory enters the neighborhood of controllability whose 
existence is claimed in Proposition HI and hence can be steered to the consensus manifold within finite 
time. Theorem [4] ensures the existence of a control able move the system on the consensus manifold 
in order to reach almost any other desired consensus point. Hence we have obtained the following 
corollary. 

Corollary 1. For every M > 0, for every initial condition (xq,vq) £ (M. d ) N x (M. d ) N , for almost every 
(xi,v\) £ (M. d ) N x Vf, there exist T > and a componentwise and time sparse control u : [0, T] — > 
(R d ) N , satisfying flSJ), such that the corresponding solution starting at (xq,vo) arrives at the consensus 
point (x\,vi) within time T. 

5 Sparse Optimal Control of the Cucker-Smale Model 

In this section we investigate the sparsity properties of a finite time optimal control with respect to a 
cost functional involving the discrepancy of the state variables to consensus and a £f - l d 2 -norm term 
of the control. 

While the greedy strategies based on instantaneous feedback as presented in Section [2] model the 
perhaps more realistic situation where the policy maker is not allowed to make future predictions, the 
optimal control problem presented in this section actually describes a model where the policy maker 
is allowed to see how the dynamics can develop. Although the results of this section do not lead 
systematically to sparsity, what is interesting to note is that the lacunarity of sparsity of the optimal 
control is actually encoded in terms of the codimension of certain manifolds, which have actually null 
Lebesgue measure in the space of cotangent vectors. 
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We consider the optimal control problem of determining a trajectory solution of Q, starting at 
(x(0), v(0)) = (xq,vq) £ (R d )^ x (M. d ) N , and minimizing a cost functional which is a combination of 
the distance from consensus with the £± — I ^-norm of the control (as in |28t [29] ) , under the control 
constraint ([8]). More precisely, the cost functional considered here is, for a given 7 > 0, 

j, TV N N 

I E((^(*)-^E«i(*)) a + 7EK(oii)*- (29) 

Jo i=i ^ j=i i=i ' 

Using classical results in optimal control theory (see for instance j5[ Theorem 5.2.1] or |10[ 164]). this 
optimal control problem has a unique optimal solution (x(-), associated with a control u on 

[0,T], which is characterized as follows. According to the Pontryagin Minimum Principle (see |54j). 
there exist absolutely continuous functions p x (-) and p v (-) (called adjoint vectors), defined on [0,T] 
and taking their values in (R d ) , satisfying the adjoint equations 

1 s a(\\xj — Xi\\) . . . . 

-i* \\Xj Xi\\ 

^ 2 N m 

Pvi = ~Px t - a (H X i ~ X i\\)(Pvj ~ Pvi) - 2l >i + JjY^ V 3> 

almost everywhere on [0,T], and p Xi (T) = p Vi (T) = 0, for every i = 1,. . . ,N. Moreover, for almost 
every t G [0, T] the optimal control u(t) must minimize the quantity 

N N 

^2(p v .(t),Wi} + 7^11^11, (31) 

i=l i=l 

over all possible w = (wi, . . . ,wn) 6 (R^)"^ satisfying YliLi ll^ll ^ M. 

In analogy with the analysis in Section [2] we identify five regions 01,02,03,04,05 covering the 
(cotangent) space (R d ) N x (R d ) N x (R d ) N x f^ N - 



01 = {(x,v,p x ,p v ) I ||p„J < 7 for every i £ {1, . . . ,N}}, 

02 = {(x, v,p x ,p v ) I there exists a unique i G {1, . . . , iV} such that || = 7 and \\p Vj || < 7 for every 

J ¥= i}, 

03 = {(x, v,p x ,p v ) I there exists a unique i £ {1, . . . , iV} such that \\p Vi \\ > 7 and \\p Vi \\ > \\p V j\\ f° r 

every j ^ i}, 

04 = {(x, v,p x ,p v ) I there exist k ^ 2 and «i, - - - , *fc £ {1, • • • , such that || = \\p Vi2 \\ = ■ ■ ■ = 

\\Pv ik II > 7 and \\p Vii \\ > \\p Vj || for every j <£ {i u . . . , i fc }}, 

05 = {(x, v,p x ,p v ) I there exist k ^ 2 and ii, . . . , G {1, . . . , iV} such that ||p Vii || = ||p^ i2 1| = • • • = 

\\Pv ik II = 7 and \\p Vj \\ < 7 for every j <£ {i u . . . , i k }}. 

The subsets 0\ and O3 are open, the submanifold O2 is closed (and of zero Lebesgue measure) and OiU 
O2 U O3 is of full Lebesgue measure in (R d ) N x (R d ) N . Moreover if an extremal (x(-), v(-),p x (-),p v (-)) 
solution of (j9j)- (|30p is in 0\ U O3 along an open interval of time then the control is uniquely determined 
from (|3ip and is componentwise sparse. Indeed, if there exists an interval I C [0, T] such that 
(x(t), v(t),p x (t),p v (t)) G Oi for every t £ I, then ([3T|) yields u(t) = for almost every t £ I. If 
(x(t),v(t),p x (t),p v (t)) £ O3 for every t £ I then (f3~Tj) yields Uj(t) = for every j ^ i and Uj(i) = 
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M ,| P "'[a| i for almost every t £ I. Finally, if (x(t),v(t),p x (t),p v (t)) G O2 for every t £ I, then (j3T 



does not determine u(i) in a unique way: it yields that Uj(t) = for every j ^ i and = —a p 



with ^ a ^ M, for almost every t £ I. However u is still componentwise sparse on /. 
The submanifolds O4 and O5 are of zero Lebesgue measure. When the extremal is in these regions, 
the control is not uniquely determined from pip and is not necessarily componentwise sparse. More 
precisely, if (x(t),v(t),p x (t),p v (t)) G O4 U O5 for every t £ I, then ([3T]) is satisfied by every control 

Pvi . (0 

of the form Uy (t) = ~ a jj^r~jt^-> 3 = 1, ■ ■ ■ , and ui = for every I ^ . . . , i^}, where the a^s 

are nonnegative real numbers such that Y^j=i a j ^ M whenever (x(t),v(t),p x (t),p v (t)) £ O5, 
and such that Ylj=i a j = M whenever (x(t),v(t),p x (t),p v (t)) G O4. We have even the following more 
precise result. 

Proposition 5. The submanifolds O4 and O5 are stratified manifolds of codimension larger than or 
equal to two. More precisely, O4 (resp., O5) is the union of submanifolds of codimension 2(k — 1) 
(resp., 2k), where k is the index appearing in the definition of these subsets and is as well the number 
of active components of the control at the same time. 

Proof. Since the arguments are similar for O4 and O5, we only treat in details the case of O4. Assume 
that ||pt;i(^)|| = IIPi^WII > 7) an d that HffyWII < ||Pui(i)|| for every j = 3, . . . , N and for every t G I. 
Differentiating with respect to t the equality 

IK(*)I| 2 = I|P, 2 (*)H 2 , (32) 

we obtain 

1 N 

(Pv 2 ,Px 2 } - {Pv!,Pxi) + j-; ^2{Pvj,a(\\xj - x 2 \\)pv 2 ~ a{\\xj - x 1 \\)p Vl )+ 

3=3 



1 N 

+ jjWPvi II 2 Yl ( a (W x i ~ ~ a (W x i ~ X2 ^ + 



3=3 



2 



N 



+ 2((p va ,«2) - {Pvi,vi)) + j^(Pv 1 -Pv 2 ,^2vj) = 0. (33) 

3=1 

These two relations are clearly independent in the cotangent space. Since a vector must satisfy (|32p and 
(|33|) . this means that the O4 is a submanifold of the cotangent space R 4cW of codimension 2. Assume 
now that \\ Pvi (t)\\ = \\Pv 2 (t)\\ = ■■■ = \\p Vk (t)l \\p vl (t)\\ >7, IK (Oil < IK (Oil &r j = k + 1, . . . , N, 
for every t £ I. Then for every pair (p Vl ,Pvj) j = 2, . . . , fc we have a relation of the kind (|32p and a 
relation of the kind (|33p . Hence O4 has codimension 2{k — 1). It follows clearly that O4 is a stratified 
manifold, whose strata are submanifolds of codimension 2{k — 1). □ 

It follows from these results that the componentwise sparsity features of the optimal control are 
coded in terms of the codimension of the above submanifolds. By the way, note that, since p x {T) = 
p v (T) = 0, there exists e > such that u(t) = for every t G [T — e,T]. In other words, at the end of 
the interval of time the extremal (x(-), v(-),p x (-),p v (-)) is in <D\. 

It is an open question of knowing whether the extremal may lie on the submanifolds O4 or O5 
along a nontrivial interval of time. What can be obviously said is that, for generic initial conditions 
((xo,vo), (p x (0),p v (0))), the optimal extremal does not stay in O4UO5 along an open interval of time; 
such a statement is however unmeaningful since the pair (p x (0),p v (0)) of initial adjoint vectors is not 
arbitrary and is determined through the shooting method by the final conditions p x (T) = p v (T) = 0. 

2 in the sense of Whitney, see e.g. [51] , 
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6 Appendix 

6.1 Proof of Lemma Q] 

For every t ^ 0, one has 

d 1 N 2 N 2 N 2 N N 

i=l i=l i=l i=l j=l 

N N N N 



( YjJ2 a (\\ x i- x j\\)( v j ~ v ii v u) + ^2J2 a (\\ x j -zi\\)(vi -Vj,v±.) 

\i=l 0=1 3=1 

. N N 

~N2 ^2^2 a (W X i - X j\\)( V i - V j> V -Li ~ v ±j) 



i=l j=l 

. N N 



i=i j=i 



Now 



i 

N \ 2 



,i=l 



\\xi - Xj\\ = \\x± i - x ±j \\ < \\x_LiW + lk±J < I ^2 \\x± i \\ 2 ) = V2NX 
and since a is nonincreasing we have the statement. 

6.2 Proof of Proposition [T] 

We split the proof of Proposition [T] in several steps. 
Lemma 2. Assume that V(0) 7^ 0, i/ien /or every t ^ 



y^(t) < -a (V2iVX(t)) y^W- 



dt 

Proof. It is sufficient to remark that 

and apply Lemma [TJ □ 
Lemma 3. For every t ^ 
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Proof. Note that for the conservation of the mean consensus parameter x±. = v±. . So 

1 d N 2 N 2 N 

i=l i=l i=l 

The sum in the last term is the scalar product on R^ between the two vectors with components 

and \\v±.\\ respectively. Applying once more the Cauchy-Schwarz inequality, on the one hand we have 



dt w N 

On the other hand 



d x ® < I { E ii 2 ) 2 (e ik ii 2 ) 2 = iVW)VW). 



d_ 



X(t) = j t [^W)^X{t)) = 2^W)-^X{t). 



□ 



Lemma 4. For every t ^ 

y/V(t) + / a{V2Nr)dr < \/V($). 
Proof. By Lemma [2] we have that 

y/Vty - y/ViO) < - f a (^2NX(sj) y/V{s)ds 



Now set r = \JX{s). By Lemma [3] — \/V{s)ds ^ —dr and, therefore, 



, , rVW) f , N 

V^X) - V v (°) < - / a ( ^2iV^J dr. 

/. /vTTTT V / 



□ 



Let us now end the proof of Proposition [U If V(0) = then the system would be already in a 
consensus situation. Let us assume then that V(0) > 0. Since 



< y/V(0) < / a (V2Nr) dr, 

then there exists X ^ X(0) such that 

y/V(0) = / a(V2Nr)dr. (34) 

Note that X may be not unique. So let X be the smallest number verifying (I34D . We claim that 
X(t) ^ X for every t and we prove it by contradiction. Indeed if there exists t such that X(t) > X 
then by Lemma 0] 



; , r\fW> , f-y^ 

VV(0) > v^P) + / a(\/2iVr)dr > / a(V2Nr)dr = y/V(0), 

JyfW) JyfW) 



that is a contradiction. 
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6.3 A technical Lemma 

We state the following useful technical lemma, used in the proof of Theorem [TJ 

Lemma 5. Let (x(-),i> (•)) be a solution of (|14p . If there exist a > and T > such that 

jV(t) < -aVm, 

for almost every t 6 [0,T], £/ien 

W*)< (VW) -^) 2 , 

and 

^ 2X(0) + =^y(0) 2 . 
cr 

Proof. Let us remind that 

1 N 1 N 

X W = ^2 E H^W " X ^)H 2 and y (*) = 2A^2 E 

i,j=l i,j=l 

Integrating ([35]) one has 

F( S ) 



-.ds ^ —at, 



and 



hence ([36]) follows. For every i,j £ {1,... , iV} we have 

- Xj^H < 11X4(0) - Xj{0)\\ + / \\vi(s) - vjis^ds 

Jo 

< ||xi(0) - xj(0)|| + \/2iV f y/V{s)ds. 

Jo 

Notice that here we used the estimate ||uj(s) — fj(s)|| 2 ^ 2N 2 i^i^i Yldm=i \\ v z{ s ) ~~ v m(s) 
2N 2 V(t). Equation ([35} implies also 



y/V{s)ds < (V(t) - WO)) < -F(0). 

a a 

Therefore, using the estimates as before, we have 

, N N / . t \ • 

X ^=2A^ ENW-^WII 2 < o^E 2 NW-^Wf+l/ ||«4(*)-tii(«)||cfa 

i,j=l i,j=l V 

E ^||x,(0) -x,(0)|| 2 +4iV 2 (j^y/VW<b) 



^ 2N 2 



< 2 



o/V 2 

2X(0) + ^W0) 2 - 
or 
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